Display for input selection on a compact information processing device

ABSTRACT

Embodiments are provided for a system, a computer program product, and/or a method that improves a display of an input selection displayed on a compact screen. To improve this display, embodiments search displayed content for input items, wherein the input items are selections inputted by a user; display different marks, each associated with each of the input items; receive a subsequent input from the user; and change a selection state of each item of the input items corresponding to a mark of the different marks in response to the subsequent input received corresponding to that mark.

BACKGROUND

The present disclosure relates to information processing and, morespecifically, to an improved display for input selection on a compactinformation processing device.

In general, as devices become more compact, the display of input itemsbecomes smaller and the selection of input items becomes more difficultusing a touch panel.

SUMMARY

According to an embodiment, a system comprising a memory having computerreadable computer instructions and a processor for executing thecomputer readable instructions is provided. The system is configured tosearch displayed content for input items, wherein the input items areselections inputted by a user. The system is further configured todisplay different marks, each associated with each of the input items;receive a subsequent input from the user; and change a selection stateof each item of the input items corresponding to a mark of the differentmarks in response to the subsequent input received corresponding to thatmark.

According to an embodiment, a computer program product is provided. Thecomputer program product comprises a computer readable storage mediumhaving program instructions embodied therewith. The program instructionsexecutable by a processor to cause the processor to search displayedcontent for input items, wherein the input items are selections inputtedby a user. The program instructions executable by the processor furthercause the processor to display different marks, each associated witheach of the input items; receive a subsequent input from the user; andchange a selection state of each item of the input items correspondingto a mark of the different marks in response to the subsequent inputreceived corresponding to that mark.

According to an embodiment, a method is provided. The method includessearching displayed content for input items, wherein the input items areselections inputted by a user. The method further includes displayingdifferent marks, each associated with each of the input items; receivinga subsequent input from the user; and changing a selection state of eachitem of the input items corresponding to a mark of the different marksin response to the subsequent input received corresponding to that mark.

Additional features and advantages are realized through the techniquesof the present invention. Other embodiments and aspects of the inventionare described in detail herein and are considered a part of the claimedinvention. For a better understanding of the invention with theadvantages and the features, refer to the description and to thedrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The subject matter which is regarded as the invention is particularlypointed out and distinctly claimed in the claims at the conclusion ofthe specification. The forgoing and other features, and advantages ofthe invention are apparent from the following detailed description takenin conjunction with the accompanying drawings in which:

FIG. 1 is a diagram of an overall configuration of an informationprocessing device in accordance with an embodiment;

FIG. 2 is an example of a screen displayed on a display unit in a normalmode in accordance with an embodiment;

FIG. 3 is another example of a screen displayed on a display unit in anassist mode in accordance with an embodiment;

FIG. 4 is a diagram that depicts a relationship between content, marks,and an input in accordance with an embodiment;

FIG. 5 is a flowchart of a main content processing performed by acontrol unit in accordance with an embodiment;

FIG. 6 is another flowchart of an assist mode processing performed by acontrol unit in accordance with an embodiment;

FIG. 7 is an example of a screen displayed on a display unit in anassist mode in accordance with an embodiment;

FIG. 8 is another example of a screen displayed on a display unit in anassist mode in accordance with an embodiment;

FIG. 9 is a flowchart of a gesture processing performed by a controlunit in accordance with an embodiment;

FIG. 10 is a diagram that depicts a display of input items in ahierarchical structure in accordance with an embodiment;

FIG. 11 is a diagram showing a change in an application of marks by amark displaying unit in accordance with an embodiment;

FIG. 12 is another diagram showing a change in an application of marksby the mark displaying unit in accordance with an embodiment; and

FIG. 13 shows an example of a hardware configuration for a computer inaccordance with an embodiment.

DETAILED DESCRIPTION

The following is an explanation of an improved display for inputselection on a compact information processing device in an embodiment ofthis disclosure with reference to the drawings. The followingembodiments do not limit the disclosure in the scope of the claims.Also, all combinations of characteristics explained in the embodimentsare not necessarily required in the technical solution of the variouspossible embodiments.

FIG. 1 is a diagram of the overall configuration of an informationprocessing device 10 in accordance with an embodiment. The informationprocessing device 10 displays marks “MK” applied to input items “IT” incontent, and receives the input of marks MK from the user. In this way,the information processing device 10 can be used by the user to easilychange the selection state of input items IT corresponding to marks MK.Examples of information processing devices 10 are small electronicdevices such as, but not limited to mobile phones, tablets, and smartphones.

As shown in FIG. 1, the information processing device 10 includes acontrol unit 12, a display unit 14, an input unit 16, and a memory unit18.

An example of a control unit 12 is a processing device such as a centralprocessing unit (CPU). The control unit 12 shown in FIG. 1 includes acontent processing unit 20, a search unit 22, and a mark displaying unit24. The control unit 12 also includes an input receiving unit 26, aswitching unit 28, and a selection unit 30. The control unit 12 can alsoread a program stored in the memory unit 18 to operate as the contentprocessing unit 20, the search unit 22, the mark displaying unit 24, theinput receiving unit 26, the switching unit 28, and the selection unit30. Some or all of the content processing unit 20, the search unit 22,the mark displaying unit 24, the input receiving unit 26, the switchingunit 28, and the selection unit 30 can be configured from hardware suchas circuitry.

The content processing unit 20 displays content on the display unit 14.The content processing unit 20 can obtain data such as a webpagecontaining input items such as a questionnaire via a network such as theinternet. The content processing unit 20 displays this webpage on thedisplay unit 14 as content. Another example of content is a webpagerequiring the user to enter information into an e-commerce order form,or an internet reservation form. Another example of content is a settingscreen for setting icons for the input buttons in the user interface ofan operating system (OS). Another example of a content processing unit20 is a browser used to browse webpages. The content processing unit 20outputs acquired content to the search unit 22.

The search unit 22 searches the displayed content for input items ITused by the user to enter selections. For example, the search item 22searches checkboxes or radio buttons in a markup language, such ashypertext markup language (HTML). The search unit 22 outputs theretrieved input items IT to the mark displaying unit 24. One example ofinput items IT is items selected by the user in a questionnaire.

The mark displaying unit 24 displays on the display unit 14 differentmarks MK associated with each of the input items IT retrieved by thesearch unit 22. For example, the mark displaying unit 24 displays on thedisplay unit 14, as a mark MK, a number assigned to each of the inputitems IT. The mark displaying unit 24 outputs the mark MK information tothe selection unit 30.

The input receiving unit 26 receives input from the user such asinstructions via the input unit 16. The input receiving unit 26 outputsthe input such as received instructions to the content processing unit20, the switching unit 28, and the selection unit 30. For example, theinput receiving unit 26 establishes an input area for the user to inputmarks MK on the screen of the display unit 14. The input receiving unit26 receives input corresponding to marks MK from the user in the inputarea. The input receiving unit 26 receives gestures as inputcorresponding to marks MK, more specifically, numerical gesture input.

In response to user instructions received, for example, via a switchingbutton displayed on the display unit 14, the switching unit 28 switchesbetween assist mode in which marks MK are displayed and gesture input isreceived, and normal mode in which marks MK are not displayed and markMK input is not received. The switching unit 28 outputs switching modeinformation to the content processing unit 20 and the selection unit 30.An example of the normal mode is the mode in which webpages are browsedusing normal browser operations. Assist mode performs normal browseroperations in addition to receiving mark MK input.

In response to receiving mark MK input from the input receiving unit 26,the selection unit 30 changes the selection state of input items ITcorresponding to marks MK. The selection states of input items ITinclude a selected state and an unselected state. For example, inresponse to the input receiving unit 26 receiving a gesture as inputcorresponding to a mark MK, the selection unit 30 changes the selectionstate of the input item IT corresponding to the mark MK. The selectionunit 30 stores the input from the user and the marks MK of the inputitems IT in the selected state in the memory unit 18 and displays themon the display unit 14. The selection unit 30 displays the marks MK forthe selected state on the display unit 14, and no longer displays a markMK when a cancel instruction has been received for the mark MK. Theselection unit 30 also receives instructions from the user, and confirmsthe selection of input items IT corresponding to marks MK changed to theselected state based on a gesture input from the user. In addition, theselection unit 30 outputs the confirmed input items IT in the selectedstate to the content processing unit 20.

The display unit 14 displays images obtained from the content processingunit 20, the mark displaying unit 24, the input receiving unit 26, theswitching unit 28, and the selection unit 30. Examples of display units14 include liquid display panels and organic EL display panels.

The input unit 16 receives input from the user. An example of an inputunit 16 is a touch panel. The input unit 16 is provided on the frontface of the display unit 14, e.g., over the entire surface of the devicefacing the user. The input unit 16 may be provided in a location otherthan the front face of the display unit 14. The input unit 16 outputsthe input received from the user to the input receiving unit 26.

The memory unit 18 is an example of a storage unit. The memory unit 18stores programs executed by the control unit 12 and parameters used toexecute the programs.

FIG. 2 is an example of a screen displayed on the display unit 14 innormal mode in accordance with an embodiment. In normal mode, thecontent processing unit 20 displays content including a plurality ofinput items IT on the screen of the display unit 14. The content shownin FIG. 2 is a questionnaire asking the user to select his or herbusiness. The content processing unit 20 displays round radio buttons 40to the left of each input item IT. The radio buttons 40 are an exampleof input buttons. In the content shown in FIG. 2, the input items IT aretypes of business such as “agriculture, forestry and fisheries/mining,”“construction industry,” and “trading company.” The user browses thecontent shown in FIG. 2 and touches the radio button 40 of the inputitem IT matching his or her business to select the type of business.

The switching unit 28 also displays on the display unit 14 a switchingbutton 42 over the content. The switching button 42 is an example of aninput object. When the user briefly touches the switching button 42 once(e.g., performs a single tap), the switching unit 28 switches from thenormal mode to the assist mode in which mark MK input is received.

FIG. 3 is an example of a screen displayed on the display unit 14 inassist mode in accordance with an embodiment. In assist mode, thecontent processing unit 20 displays the same content as the normal modeon the screen of the display unit 14. In assist mode, the markdisplaying unit 24 displays marks MK on the display unit 14. In theexample shown in FIG. 3, the mark displaying unit 24 displays, as marksMK, consecutive numbers 1 through 19 next to the radio buttons 40 foreach of the input items IT. The selection unit 30 establishes anddisplays a partially circular input area 44 in the lower right corner ofthe screen on the display unit 14 indicated by the dot shading. Whenuser input such as gesture input in the input area 44 is received by theinput receiving unit 26, the selection unit 30 determines whether or notthe input corresponds to one of the marks MK. When it has beendetermined that the input corresponds to one of the marks MK, the markMK is displayed in the input area 44. In the example shown in FIG. 3,the selection unit 30 receives and displays “4” as the mark MK.

FIG. 4 is a diagram that depicts a relationship between content, marksMK, and an input area 44 in accordance with an embodiment. As shown inFIG. 4, the input area 44 and the marks MK are displayed above thecontent on the screen of the display unit 14. Therefore, the markdisplaying unit 24 superimposes the same round mark MK on the displayunit 14 above the radio buttons 40 to the left of each of the inputitems IT in the content. The selection unit 30 also superimposes theinput area 44 over the images in the overlapping area of content on thedisplay unit 14. In this case, the selection unit 30 preferably displaysthe input area 44 as a transparent image. In this way, the selectionunit 30 can display the input area 44 so that the underlying content canbe viewed in the input area 44.

The input area 44 shown in FIG. 4 is also above the content during inputfrom the input unit 16. Consequently, the input receiving unit 26outputs input such as gesture input GS from the user as received by theinput unit 16 in the input area 44 to the selection unit 30. Forexample, when the user slides (swipes) the touch point vertically in theinput area 44 of the input unit 16, the input receiving unit 26, and notthe content processing unit 20, inputs the input to the selection unit30. In this way, the content processing unit 20 does not scroll thecontent vertically during the input. Further, the selection unit 30determines whether or not the gesture input GS corresponds to any one ofthe marks MK.

FIG. 5 is a flowchart of an embodiment of the main content processingperformed by the control unit 12. When the user briefly touches (taps)the area in which an icon is displayed on the browser (where the browseris operating as the content processing unit 20), the control unit 12starts content processing by reading and executing a program stored inthe memory unit 18.

During content processing, as shown in FIG. 5, the content processingunit 20 displays on the display unit 14 content acquired via the network(block S10). Next, the search unit 22 searches for input items IT in thecontent to determine whether any input items IT are present (block S12).When the search unit 22 determines that no input items IT are present(block S12: No), the results are outputted to the content processingunit 20. The content processing unit 20 continues in normal mode anddisplays the content normally (block S24). However, when the search unit22 determines that input items IT are present (block S12: Yes), theresults are outputted to the switching unit 28.

The switching unit 28 determines whether or not the current mode is theassist mode (block S16). When the switching unit 28 determines that thecurrent mode is the assist mode (block S16: Yes), the assist modeprocessing described below is executed and assist mode is continued(block S22).

When the switching unit 28 determines that the current mode is not theassist mode (block S16: No), the switching button 42 is displayed (blockS18). Next, when instruction input entered by the user using the inputunit 16 is received via the input receiving unit 26, the switching unit28 determines whether or not the input is a touch in the area of theswitching button 42 (block S20). When the switching unit 28 determinesthat the input is not a touch in the area of the switching button 42(block S20: No), the processing in block S24 is executed. When itdetermines that the input is a touch in the area of the switching button42 (block S20: Yes), the switching unit 28 switches to the assist modeand executes the assist mode processing described below (block S22).

FIG. 6 is a flowchart of the assist mode processing performed by thecontrol unit 12 in block S22 in accordance with an embodiment. FIG. 7and FIG. 8 are examples of screens displayed on the display unit 14 inassist mode in accordance with embodiments.

During assist mode processing, as shown in FIG. 6, the search unit 22analyzes the content displayed or the content to be displayed on thedisplay unit 14, and outputs information on the position of each inputitem IT on the screen of the display unit 14 or on the input unit 16 tothe mark displaying unit 24 (block S30). When information related toeach input item IT has been acquired from the search unit 22, the markdisplaying unit 24 assigns a number to each input item IT as a mark MK,and displays the marks MK on the display unit 14 (block S32).

Next, the input receiving unit 26 establishes an input area 44 (blockS34). In this case, the input receiving unit 26 preferably establishesthe input area 44 in a predetermined region from the region in which theswitching button 42 is displayed. In this way, after the switchingbutton 42 has been operated, the information processing device 10 allowsthe user to enter information in the input area 44 using the same fingerwithout having to change how the information processing device 10 isbeing held. When user input has been received from the input unit 16,the input receiving unit 26 determines whether or not the input was inthe input area 44 (block S36). When it has been determined that theinput was in the input area 44 (block S36: Yes), the input receivingunit 26 outputs information related to the input to the selection unit30. The information related to the input is information on the positiontouched by the user on the input unit 16. When the position touched bythe user moves, the information related to the input includesinformation on the positions touched during the movement and timeinformation for each position.

The selection unit 30 determines whether or not the input is a movinginstruction based on the information related to the user input on theinput unit 16 inputted from the input receiving unit 26 (block S38). Forexample, the selection unit 30 determines that the user input is amoving instruction when the time the user touches the initial positionis longer than a predetermined amount of time (a long touch) and thenthe touched position moves. When the selection unit 30 determines thatthe input is a moving instruction (block S38: Yes), the distance anddirection of the moving touch position are combined, and the input area44 is moved on the screen on the display unit 14 (block S40). Forexample, when it has been determined that the user touch position hasmoved, the selection unit 30 moves the input area 44 displayed in thelower right corner in FIG. 3 upward as shown in FIG. 7. As shown in FIG.7, the selection unit 30 can change the shape of the input area 44depending on the display position. For example, when the input receivingunit 26 determines that the input is at a central position and asemicircular input area 44 protrudes from the screen, the selection unit30 may apply the protruding portion as shown in FIG. 3.

When it has been determined that the input is not a moving instruction(block S38: No), the selection unit 30 determines whether or not theuser input is an instruction confirming a number inputted using agesture input GS (block S42). For example, after the user has touchedthe input unit 16, the selection unit 30 determines that the input was aconfirmation instruction when the input is quickly removed from theinput unit 16 (a single tap) (block S42: Yes). When it has beendetermined that the input is not a confirmation instruction but theinput of a mark MK using a gesture input GS (block S42: No), theselection unit 30 executes gesture processing to analyze, store anddisplay the gesture input GS (block S44). The gesture processingperformed to analyze, store and display gesture inputs GS is describedbelow.

When it has been determined that the input is a confirmation instruction(block S42: Yes), the selection unit 30 determines whether or not thenumber inputted by the gesture input GS is stored in the memory unit 18(block S46). When it has been determined that the input is a stored markMK (block S46: Yes), the selection unit 30 determines whether or not thestored input number matches one of the numbers in the marks MK assignedto input items IT (block S48). When it has been determined that theinputted number matches the number of a mark MK (block S48: Yes), aclick event for the input item IT corresponding to the number isoutputted to the browser (block S50). The process is then executed againbeginning with block S36. By repeatedly executing the process beginningwith block S36, the selection unit 30 can change the selection state oftwo or more input items IT corresponding to two or more marks MK whenthe user has entered two or more numbers corresponding to two or

When, in block S48, a number stored in the memory unit 18 does not matchthe number of any mark MK (block S48: No), the selection unit 30 clearsall of the stored numeric symbols (block S52). When a stored number isdisplayed in the input area 44, the selection unit 30 also clears thedisplayed number. The process is then executed again beginning withblock S36.

When, in block S46, the selection unit 30 determines that there are nostored numeric symbols (block S46: No), the switching unit 28 releasesthe assist mode (block S54) and executes the processing in block S14.

When, in block S36, it has been determined that the user input receivedby the input receiving unit 26 is input in an area other than the inputarea 44 (block S36: No), the selection unit 30 clears the numericsymbols stored in the memory unit 18 (block S56). Note that theselection unit 30 clears the number displayed in the input area 44 andnumbers displayed for input items IT. The content processing unit 20executes normal browser operations according to the user input (blockS58).

For example, during normal browser operations, when the user moves thetouch position on the input unit 16 outside of the input area 44, thecontent processing unit 20 moves the image of the content upward insidethe screen on the display unit 14. The process is then executed againbeginning with block S30. Because the selection unit 30 clears thenumbers of the input items IT in block S56, the mark displaying unit 24assigns new numbers as marks MK to the input items IT in blocks S30 andS32. Consequently, as shown in FIG. 8, because input item “transportindustry/postal service” assigned number “10” is displayed in the topposition before scrolling upward, the mark displaying unit 24 assignsnumber “1” as the mark MK to the input item IT.

Another example of normal browser operations is the direct selection ofinput items IT by the user. In this case, for example, the mark displayunit 24 may continue to display radio buttons 40 for the user to inputitems IT. The display of radio buttons 40 may be superimposed over thedisplay of marks MK. In this way, the content processing unit 20 canchange the selection state of an input item IT when the user touches thearea in which a radio button 40 is displayed for the input item IT.

FIG. 9 is a flowchart of the gesture processing performed by the controlunit 12 in block S44 in accordance with an embodiment. During gestureprocessing, as shown in FIG. 9, the selection unit 30 analyzes thetrajectory of the user touch positions inside the input area 44 as thetrajectory of gesture input GS (block S70). The selection unit 30determines whether the gesture unit GS whose trajectory has beenanalyzed is the predetermined gesture input GS for a cancel instruction(block S72). An example of a predetermined gesture input GS for a cancelinstruction is moving the touch position on the input unit 16 to theleft from the right side (a flick).

When it has been determined that the user input is not a cancelinstruction (block S72: No), the selection unit 30 determines whether ornot the analyzed gesture input GS is a numeric symbol (block S74). Whenit has been determined that the analyzed gesture input GS is a numericsymbol (block S74: Yes), the selection unit 30 stores the numeric symbolin the memory unit 18 and displays the numeric symbol in the input area44 (block S76). For example, when the trajectory of the user's gestureinput GS resembles the shape of the numeric symbol “4” stored in thememory unit 18, as shown in FIG. 4, the selection unit 30 determinesthat the gesture input GS is the numeric symbol “4,” and displays thenumber “4” in the input area 44 as shown in FIG. 3. When it has beendetermined that the analyzed gesture input GS is not a numeric symbol(block S74: No), the selection unit 30 does not execute block S76. Theprocess is then executed again beginning with block S36 in FIG. 6.

When it has been determined that the user input is a cancel instruction(block S72: Yes), the selection unit 30 determines whether the storednumber is in the memory unit 18 (block S78). When it has been determinedthat a stored numeric symbol is present (block S78: Yes), the selectionunit 30 clears at least one numeric symbol stored in the memory unit 18(block S80). When the cleared numeric symbol is being displayed in theinput area 44, the selection unit 30 clears the numeric symbol as well.When it has been determined that the stored numeric symbols are notpresent (block S78: No), the selection unit 30 does not execute blockS80. The process is then executed again beginning with block S36 in FIG.6.

As explained above, in the information processing device 10, the numbersassigned to input items IT retrieved by the search unit 22 are displayedby the mark displaying unit 24 as marks MK. When mark MK input isreceived in the form of user gesture input GS in the input area 44, theselection unit 30 determines that a mark MK has been selected andchanges the selection state. In this way, the user can easily select aninput item IT in the information processing device 10 by entering a markMK even when the display of input items IT is small. Therefore, in theinformation processing device 10, the user does not have to select inputitems IT by enlarging them outside of the screen. In this way, theinformation processing device 10 can eliminate operations that have tobe performed by the user such as enlarging and shrinking to return thescreen to normal.

Also, because the search unit 22 searches for input items IT to assignmarks MK, the information processing device 10 can realize the effectsdescribed above for various types of content with different input itemsIT. When content is created, the creator also has a greater degree offreedom in constructing content including input items IT. In this way,users can easily and accurately select input items IT even when acreator transfers content designed for a larger personal computer to asmaller smartphone or tablet.

The following is an explanation of partial modifications of theinformation processing device 10 described above.

In the assist mode of the embodiment described above, when the inputreceiving unit 26 receives user input in an area outside of the inputarea 44, the switching unit 28 clears stored numeric symbols andcontinues in the assist mode. However, when the input receiving unit 26receives user input in an area outside of the input area 44, theswitching unit 28 may also end the assist mode in which marks MK arereceived. Also, when the selection unit 30 has stored at least one userinput in the memory unit 18 and the switching unit 28 has endedreception of marks MK, the input stored in the memory unit 18 may becleared.

In the embodiment described above, the selection unit 30 receives asingle number including numeric symbols with a plurality of digits.However, a range of numbers including a plurality of numbers may bereceived as input corresponding to marks MK. For example, when “2,” “-,”and “6” are received in successive order in the input area 44 as usergesture input GS, the selection unit 30 may change the selection stateof the input items IT with the marks MK ranging from 2 to 6.

The mark displaying unit 24 may display marks MK for some of the inputitems IT out of all the input items IT, while not displaying marks MKfor the remaining input items IT. In this case, the selection unit 30may receive input items IT for which marks MK are displayed, and inputitems IT for which no marks MK are displayed. For example, the markdisplaying unit 24 may display marks MK for input items IT whose displaysize is smaller than predetermined size Th1. An example of predeterminedsize Th1 is from several mm to several cm in the vertical direction. Inthis case, the mark displaying unit 24 assigns and displays a mark MKfor any displayed input item IT whose size in the vertical direction isless than size Th1, but does not display a mark MK for any remainingdisplayed input item IT whose size in the vertical direction is greaterthan size Th1. In this way, the user can select small input items IT byentering marks MK, but select larger input items IT by touching themdirectly. In this case, the switching unit 28 may automatically receivethe input of marks MK for any displayed input item IT whose size issmaller than size Th1.

FIG. 10 is a diagram used to explain the display of input items IT in ahierarchical structure in accordance with an embodiment. When there aremultiple input items IT in a hierarchical structure, the mark displayingunit 24 does not display marks MK for primary input items IT, but maydisplay marks MK for secondary input items IT on the level lower thanthe primary input items IT. In this case, as shown in FIG. 10, the markdisplaying unit 24 does not display marks MK for input items“manufacturing” and “service industry” in the higher level among theinput items IT in the hierarchical structure, but does display marks MKfor input items “food products” and “wood/wooden products” in the levelbelow the input items IT in the higher level. In this way, theinformation processing device 10 can automatically switch to assist modeeven when the user has not operated a switching button. The informationprocessing device 10 can allow lower level input items IT that areusually displayed in a small size by entering marks MK, but allow theuser to select higher level input items IT that are usually displayed ina large size by directly touching them.

The mark displaying unit 24 may display marks MK for input items IT oncondition that the interval between input items IT is smaller thaninterval threshold value Th2. In this way, the information processingdevice 10 can switch automatically to the assist mode even when the userhas not operated a switching button. Even when the interval betweeninput items IT is narrow and input items IT are very close to eachother, the information processing device 10 can allow the user to easilyselect an input item IT.

The selection unit 30 may display selected marks MK in successive order.For example, when the user has selected marks MK “1,” “3,” and “8”corresponding to input items IT. “1,” “3,” and “8” may be displayed inthe input area 44.

FIG. 11 is a diagram showing a change in the application of marks MK bythe mark displaying unit 24 in accordance with an embodiment. When thedisplay of input items IT on the screen has been changed in response toa change in content, the mark displaying unit 24 may continue toassociate the marks MK with input items IT before and after the change.In FIG. 11, for example, the content screen has been scrolled upwardfrom FIG. 3. In this case, the mark displaying unit 24 continues todisplay the original marks MK 10 through 19 for input items “transportindustry/postal service” through “other service industry.” Note that themark displaying unit 24 assigns and displays a new number “20” as a markMK for newly displayed input item “government/civil service/publicorganization.”

FIG. 12 is a diagram showing a change in the application of marks MK bythe mark displaying unit 24 in accordance with an embodiment. The markdisplaying unit 24 generates, as a mark MK, a character for at least oneinput item IT of the content, and displays the character on the displayin a manner different from the other characters in the input items IT.In the example shown in FIG. 12, the mark displaying unit 24 generates,as a mark MK, the initial character in each input item IT. The markdisplaying unit 24 surrounds the initial character in a box which setsit apart from the other characters. The initial character can be setapart by highlighting it with a fluorescent color, changing the color ofthe character, or underlining the character.

In the embodiment described above, the input receiving unit 26establishes an input area 44 with a partially circular shape. However,the input receiving unit 26 can change the shape and location of theinput area 44 in response to a user instruction. The input receivingunit 26 can also change the size, transparency, and initial position ofthe input area 44 in response to a user instruction.

In the embodiment described above, the mark displaying unit 24 displaysmarks MK with the same round shape as the radio buttons 40. However, themark displaying unit 24 can change the shape of the marks MK to conformto the shape of the radio buttons 40 or in response to a userinstruction.

In the embodiment described above, the switching unit 28 fixes thelocation of the switching button 42. However, switching unit 28 can movethe location of the switching button 42 in response to a userinstruction. For example, after the user has pressed down for a longperiod of time on the area with the switching button 42 and then movesthe touch position (touch-and-drag), the switching unit 28 can move theswitching button 42 in accordance with the movement.

In the embodiment described above, the selection unit 30 receives agesture input GS as a numeric symbol when the shape of the gesture inputGS resembles the shape of a numeric symbol. However, this embodiment isnot limiting. For example, the selection unit 30 may determine whichnumeric symbol has been inputted based on a predetermined gesture inputGS linked to that numeric symbol. More specifically, a gesture input GSmoving in a straight horizontal line may be established for the numericsymbol “1,” a gesture input GS moving in a straight vertical line may beestablished for the numeric symbol “2,” and a gesture input GS moving ina circle may be established for the numeric symbol “3.” In this way, theselection unit 30 can improve the accuracy for determining numericsymbols resembling shapes such as “5” and “6.”

The input receiving unit 26 may establish the entire content displayarea as the input area 44 for the user to input marks MK.

In the assist mode, the switching unit 28 may display a switching buttonfor ending the assist mode on the display unit 14.

When the input corresponding to a previously selected input item IT ischanged, the selection unit 30 may change the state of the input item ITfrom selected to unselected.

In the embodiment described above, a webpage was used as the example ofcontent. However, the information processing device 10 can be applied toother types of content including input items IT that can be selected.

FIG. 13 shows an example of a hardware configuration for a computer 1900in accordance with an embodiment. The computer 1900 related to thepresent embodiment is an example of an information processing device 10.The computer 1900 in the present embodiment is equipped with a CPUperipheral portion having a CPU 2000, RAM 2020, graphics controller 2075and display device 2080 connected to each other by a host controller2082, an input/output portion having a communication interface 2030, anda hard disk drive 2040 connected to the host controller 2082 by aninput/output controller 2084, and a legacy input/output portion having aROM 2010, memory drive 2050, and input/output chip 2070 connected to theinput/output controller 2084.

The host controller 2082 is connected to RAM 2020, a CPU 2000 accessingthe RAM 2020 at a high transfer rate, and a graphics controller 2075.The CPU 2000 is operated on the basis of a program stored in the ROM2010 and the RAM 2020, and controls the various units. The graphicscontroller 2075 acquires the image data generated in the frame buffer ofthe RAM 2020 by the CPU 2000 and other units, and displays this imagedata on the display device 2080. Alternatively, the graphics controller2075 can include a frame buffer for storing image data generated by theCPU 2000 and other units.

The input/output controller 2084 is connected to a host controller 2082,a communication interface 2030 serving as a relatively high-speedinput/output device, and a hard disk drive 2040. The communicationinterface 2030 communicates with the other devices via a network. Thehard disk drive 2040 stores the programs and data used by the CPU 2000in the computer 1900.

The input/output controller 2084 is connected to the ROM 2010, thememory drive 2050, and the relatively low-speed input/output device ofthe input/output chip 2070. The ROM 2010 stores the boot programexecuted by the computer 1900 at startup and/or programs relying onhardware in the computer 1900. The memory drive 2050 reads programs ordata from a memory card 2090, and provides the programs and data to thehard disk drive 2040 via the RAM 2020. The input/output chip 2070connects the memory drive 2050 to the input/output controller 2084, andvarious types of input/output devices are connected to the input/outputcontroller 2084 via a parallel port, serial port, keyboard port, ormouse port, etc.

A program provided to the hard disk drive 2040 via the RAM 2020 isstored on a recording medium such as a memory card 2090 or an IC cardprovided by the user. A program is read from the recording medium,installed in the hard disk drive 2040 inside the computer 1900 via theRAM 2020, and executed by the CPU 2000.

Programs installed in the computer 1900 to enable the computer 1900 tooperate as an information processing device 10 include a content module,search module, mark display module, input receiving module, switchingmodule, and selection module. These programs or modules work with theCPU 2000 and other components to cause the computer 1900 to operate asthe content module, search module, mark display module, input receivingmodule, switching module, and selection module.

The information processing operations written in these programs arespecific means activated by reading the programs to the computer 1900 sothat the software cooperates with the various types of hardwareresources described above. These specific means operate as the contentmodule, search module, mark display module, input receiving module,switching module, and selection module. These specific means realizeoperations and the processing of information in the computer 1900 of thepresent embodiment to construct a dedicated information processingdevice 10 for the intended purpose.

For example, when the computer 1900 communicates with an externaldevice, the CPU 2000 executes the communication program loaded in theRAM 2020, and instructs the communication interface 2030 in thecommunication processing on the basis of the processing contentdescribed in the communication program. The communication interface 2030is controlled by the CPU 2000, and reads the transmitted data stored inthe transmission buffer region of a memory device such as the RAM 2020,hard disk drive 2040, or memory card 2090, or writes reception datareceived from the network to a reception buffer region of the storagedevice. In this way, the communication interface 2030 exchanges datawith a storage device using the direct memory access (DMA) method.Alternatively, the CPU 2000 may exchange data by retrieving data fromthe source storage device or communication interface 2030, and writingthe data to the destination communication interface 2030 or storagedevice.

Also, the CPU 2000 writes all of the data or the necessary data to theRAM 2020 via, for example, a DMA transfer, from files or databasesstored in an external storage device such as a hard disk drive 2040 or amemory drive 2050 (memory card 2090), and performs various types ofprocessing on the data in the RAM 2020. The CPU 2000 then writes theprocessed data to an external storage device via, for example, a DMAtransfer. Because the RAM 2020 temporarily stores the contents of theexternal storage device during this process, the RAM 2020 and theexternal storage device are generally referred to in the presentembodiment as memory, a memory unit, or a memory device. The varioustypes of information in the programs, data, tables and databases of thepresent embodiment are stored in these memory devices, and are thetargets of information processing. The CPU 2000 can hold some of the RAM2020 in cache memory, and read and write data to the cache memory. Inthis case, the cache memory performs some of the operations of the RAM2020. Therefore, this division is excluded in the present embodiment.Cache memory is included in the RAM 2020, the memory, and/or the memorydevice.

The CPU 2000 also performs various types of processing on data read fromthe RAM 2020 including the operations, processing, conditiondetermination, and information retrieval and substitution described inthe present embodiment and indicated by a sequence of instructions inthe program, and writes the results to the RAM 2020. For example, whenperforming a condition determination, the CPU 2000 compares varioustypes of variables described in the present embodiment to othervariables or constants to determine whether or not conditions such asgreater than, less than, equal to or greater than, equal to or less thanor equal to have been satisfied. When a condition has been satisfied (ornot satisfied), the process branches to a different sequence ofinstructions or calls up a subroutine.

A program or module described above can be stored in a recording mediumof an external unit. Instead of a memory card 2090, the recording mediumcan be an optical recording medium such as a DVD or CD, amagneto-optical recording medium such as MO, a tape medium, or asemiconductor memory such as an IC card. The recording medium can alsobe a storage device such as a hard disk or RAM provided in a serversystem connected to a dedicated communication network or the internet,and the program can be provided to the computer 1900 via the network.

In accordance with an embodiment, an information processing device mayincluding a search unit for searching displayed content for input items,the input items being selections inputted by a user; a mark displayingunit displaying a different mark associated with each of the retrievedinput items; an input receiving unit for receiving input from the user;and a selection unit for changing the selection state of each input itemcorresponding to a mark in response to input corresponding to the markbeing received by the input receiving unit. Other embodiments mayimplement this information processing device as a computer programproduct and/or a method corresponding thereto.

In accordance with another embodiment, an information processing deviceis provided. The information processing device comprises a search unitfor searching displayed content for input items, the input items beingselections inputted by a user; a mark displaying unit displaying adifferent mark associated with each of the retrieved input items; aninput receiving unit for receiving input from the user; and a selectionunit for changing the selection state of each input item correspondingto a mark in response to input corresponding to the mark being receivedby the input receiving unit.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can change the selectionstate of the input item corresponding to a mark in response to the inputreceiving unit receiving a gesture from the user as input correspondingto the mark.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can confirm the selection ofan input item corresponding to the mark in response to receiving aninstruction from the user.

In accordance with another embodiment or the information processingdevice embodiment above, the input receiving unit can establish an inputarea on the screen for the user to enter marks.

In accordance with another embodiment or the information processingdevice embodiment above, the input receiving unit can further comprise aswitching unit for ending the reception of marks when user input isreceived in an area outside of the input area.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can store at least one inputfrom the user in the storage unit, and clear the input stored in thestorage unit when the switching unit ends the reception of marks.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can clear at least one inputstored in the storage unit when a cancel instruction is inputted by theuser.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can display numbers asmarks, and the input receiving unit can receive numerical gesture inputsfrom the user as input corresponding to the marks.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can receive a range ofnumbers as input corresponding to the marks.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can change the selectionstate of two or more input items corresponding to two or more marks inresponse to the user inputting two or more inputs corresponding to twoor more marks.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can maintain thedisplay of an input button for the user to input an input item.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can display marks forsome of the input items and not display marks for the remaining inputitems, and the selection unit can receive input for input itemsdisplaying marks and input for input items not displaying marks.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can display marks forinput items having a display size smaller than a predetermined size.

In accordance with another embodiment or the information processingdevice embodiment above, the information processing device can furthercomprise a switching unit for starting reception of mark input when thedisplay size of any one of the input items is smaller than apredetermined size.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can avoid the displayof marks for primary input items and can display marks for secondaryitems in a level lower than the primary input items among a plurality ofitems having a hierarchical structure.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can display marks forinput items on condition that the interval between inputted items isless than an interval threshold value.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can display selected marksin sequential order.

In accordance with another embodiment or the information processingdevice embodiment above, the selection unit can display selected marks,and avoid a display of a mark in response to receiving a cancelinstruction for the mark.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can maintain inputitems and the corresponding marks displayed before and after the changein the display when the display of an input item on the screen has beenchanged in response to a change in the display of content.

In accordance with another embodiment or the information processingdevice embodiment above, the mark displaying unit can generate, as amark, a character for at least one input item of the content, anddisplay the character on the display in a manner different from othercharacters for input items.

In accordance with another embodiment, a program is provided. Theprogram causing a computer to operation as a search unit for searchingdisplayed content for input items, the input items being selectionsinputted by a user; a mark displaying unit displaying a different markassociated with each of the retrieved input items; an input receivingunit for receiving input from the user; and a selection unit forchanging the selection state of each input item corresponding to a markin response to input corresponding to the mark being received by theinput receiving unit.

In accordance with another embodiment, a method is provided. The methodcomprises searching displayed content for input items, the input itemsbeing selections inputted by a user; displaying a different markassociated with each of the retrieved input items; receiving input fromthe user; and changing the selection state of each input itemcorresponding to a mark in response to input corresponding to the markbeing received by the input receiving unit.

The technical scope of embodiments herein should not be construed aslimiting. The possibility of many changes and improvements to theseembodiments should be apparent to those skilled in the art. Embodimentsincluding these changes and improvements are within the technical scope,as should be clear from the description of the claims.

The order of execution for operations and processes in the devices,systems, programs and methods described in the claims, description anddrawings was described using terms such as “previous” and “prior.”However, these operations and processes can be realized in any order aslong as the output of the previous process is used by the subsequentprocess. The operational flow in the claims, description and drawingwere explained using terms such as “first” and “next” for the sake ofconvenience. However, the operational flow does not necessarily have tobe executed in this order.

What is claimed is:
 1. A system, comprising: a search unit configured tosearch content displayed on a display device for input items, whereinthe input items are selections inputted by a user; a mark displayingunit configured to display different marks, each associated with each ofthe input items, wherein the mark displaying unit is configured todisplay numbers as the different marks; an input receiving unitconfigured to receive a subsequent input from the user comprising anumerical gesture input comprising a range of numbers, wherein the inputreceiving unit is further configured to establish an input area on ascreen of the system to receive the subsequent input from the user; aselection unit configured to change a selection state of each item ofthe input items corresponding to a mark of the different marks inresponse to the subsequent input received corresponding to that mark;and a switching unit configured to switch from a normal mode to anassist mode in response to input to a switching button by the user,wherein the numerical gesture input further comprises a numericalgesture input representing a first number comprising 2, a numericalgesture input representing a horizontal line, and a numerical gestureinput representing a second number comprising 6; wherein the selectionunit is further configured to change a selection state for eachrespective item corresponding to the first number, the second number,and each respective number between the first number and the secondnumber; and wherein the mark displaying unit is further configured tomaintain a display of an input button, the input button configured toenable an input of the input items.